Image Processing Apparatus, Image Processing Method, and 
Image Processing Program Storage Medium 

BACKGROUND OF THE INVENTION 

i) Field of the Invention 

The present invention relates to an image processing 
apparatus and an image processing method for subjecting a 
medical image represented by digital data in a medical field 
to an image processing, and an image processing program 
storage medium in which an image processing program for 
operating a computer system as such image processing 
apparatus is stored. 

ii) Description of Related Art 

With a medical progress and a rapid progress of an 
information processing technique, digitization of a medical 
image has been advanced, social basis has been prepared and 
importance of medical image diagnosis has increased. Reading 
of a simple radiograph (image diagnosis) has heretofore been 
performed by a method of output ting an image to a film and 
diagnosing the image. In this method, diagnosis expenses 
(direct expenses of a film, film bag, and the like and 
managing/working expenses) associated with film operation are 
required, output of a plurality of films is sometimes needed 
in accordance with an image diagnosis purpose, and 
considerable cost -up problems such as a diagnosis expense 
increase and diagnosis time increase arise. 

From now on, it is expected that it is essential in 
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future to use a CRT monitor on a computer, observe an image 
and read the image (diagnose the image). In this case, an 
image quality level equivalent to or higher than that of the 
film is required. 

When a chest image or another simple radiograph is 
displayed as it is by the CRT monitor, digital data of the 
simple radiograph outputted from a computed radiography (CR) 
photography device is original image data dependent on the 
device, or image data having no contrast and being unsuitable 
for medical image diagnosis. Additionally, the CR 
photography device itself is constituted in consideration of 
a film property, and a problem occurs that the image data is 
not formed by considering any CRT monitor. 

Therefore, it is proposed to perform an image 
processing in such a manner that an image suitable for 
diagnosis is executed and to display the image subjected to 
the image processing for diagnosis instead of displaying the 
image as it is on the CRT monitor. 

Additionally, to handle various medical images, an 
image processing condition is adjusted in such a manner that 
a satisfactory image can be obtained for a certain medical 
image (e.g., a chest simple radiograph), but an image 
unsuitable for diagnosis is obtained for another medical 
image (e.g., mammography), and there is a problem that it is 
remarkably difficult to set an image processing condition. 

Moreover, even with a medical image photography 
device of the same device type, the setting condition for 



photography of the medical image photography device differs 
with a hospital in which the medical image photography device 
is installed, or there is a difference in a hospital doctor's 
liking and experience in observation, and in this case it is 
a problem to provide individual hospitals or individual users 
with the medical image easy to observe. 

Furthermore, for example, it is also a problem to 
present an area of interest as an image easy to see, or to 
present an image suitable for observation of symmetry when 
the symmetry of a human body is to be observed. 

SUMMARY OF THE INVENTION 
The present invention has been developed in 
consideration of the aforementioned circumstances, and an 
object thereof is to provide an image processing apparatus 
and an image processing method by which a processing suitable 
for observation can be performed with respect to various 
medical images, and an image processing program storage 
medium in which an image processing program for operating a 
computer system as the image processing apparatus is stored. 

To achieve the aforementioned object according to 
the present invention there is provided an image processing 
apparatus for subjecting a medical image to an image 
processing, comprising : 

an image processing condition storing section for 
storing an image processing condition when the medical image 
is subjected to the image processing in accordance with a 
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photography device type and a photography condition when the 
medical image is obtained; 

a data obtaining section for obtaining the medical 
image, and the photography device type and the photography 
5 condition when the medical image is obtained; and 

an image processing section for reading the image 
processing condition for the same photography device type and 
photography condition as the photography device type and 
photography condition obtained by the data obtaining section 
Q=0 from the image processing condition storing section, and 
SI subjecting the medical image obtained by the data obtaining 

section to the image processing in accordance with the read 
image processing condition. 

For the image processing apparatus of the present 
j == l 5 invention, when the image processing condition is stored 

beforehand in accordance with the photography device type and 
photography condition for obtaining the medical image as 
described above, and the medical image is subjected to the 
image processing, the image processing is performed in 
20 accordance with the image processing condition adapted to the 
medical image, various medical images are subjected to 
respective appropriate image processings, and an image 
suitable for diagnosis can be obtained with respect to any 
medical image . 

25 Here, in the image processing apparatus of the 

present invention, the image processing section subjects the 
medical image obtained by the data processing section to at 
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least a gradation conversion processing and a frequency 
emphasis processing, and 

the image processing condition storing section 
preferably stores a frequency emphasis function indicating a 
degree of frequency emphasis in which a gradation conversion 
function and an average density around respective points -of 
the medical image are used as variables in accordance with 
the photography device type and the photography condition. 

When a gradation processing is performed using the 
gradation conversion function in accordance with the 
photography device type and photography condition, and a 
frequency emphasis processing is performed using the 
frequency emphasis function indicating the degree of 
frequency emphasis with the densities of the respective 
points of the medical image used as the variables, the image 
suitable for diagnosis can be obtained. 

Furthermore, in the image processing apparatus of 
the present invention, before the gradation conversion 
processing, the image processing section preferably subjects 
the medical image obtained by the data obtaining section to a 
luminance correction processing using a dynamic range 
compression function in which the average density around the 
respective points of the medical image is used as the 
variable . 

For example, when a chest image or another image 
provided with a broad diagnosis visible area is compared with 
an image recorded on a film in image quality, without 
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performing the luminance correction processing, by 
emphasizing contrast (enlarging a dynamic range) to enhance a 
diagnosis performance, a low density portion changes to be 
white, a high density portion changes to be black, 
information disappears, an area able to be diagnosed is 
narrowed, and an image suitable for the object cannot be- 
formed in some cases . 

In this case, when the luminance correction 
processing is performed as described above, the dynamic range 
as the entire image is compressed to preserve density 
graduation. Additionally, since a fine structure on the 
image is kept by the luminance correction processing, as 
compared with a simple luminance correction processing, the 
image more suitable for the diagnosis purpose can be obtained 
by the subsequent image processing. 

Moreover, the image processing apparatus of the 
present invention is preferably provided with an image 
processing condition operating section for adding, changing, 
and deleting the image processing condition in response to an 
operation . 

By providing the image processing condition 
operating section, the image processing condition can be 
adjusted, for example, for each image processing apparatus, 
or for each user which uses the image processing apparatus 
even with one image processing apparatus, and the image 
provided with a satisfactory observation performance can be 
obtained in accordance with an environment in which the image 
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processing apparatus is installed, user's liking, and the 
like. 

Moreover, for the image processing apparatus of the 
present invention, the medical image subjected to the image 
processing may be transferred to another apparatus, but the 
image processing apparatus itself of the present invention is 
preferably provided with an image display section for 
displaying the medical image subjected to the image 
processing by the image processing section. 

Here, the apparatus is preferably provided with an 
interested area designating section for designating a desired 
area of interest on the medical image displayed in the image 
display section in response to the operation, and the image 
display section lowers a luminance of an area excluding the 
area of interest designated by the interested area 
designating section to display the medical image. 

Moreover, in this case, the interested area 
designating section preferably designates the desired area of 
interest on the medical image displayed in the image display 
section and designates a coefficient indicating a degree of 
drop of the luminance of the area excluding the area of 
interest in response to the operation, and the image display 
section lowers the luminance of the area excluding the area 
of interest designated by the interested area designating 
section down to the luminance in accordance with the 
coefficient designated by the interested area designating 
section to display the medical image. 
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When the area of interest is designated on the 
medical image, by lowering the luminance of the area except 
the area of interest on the medical image and displaying the 
medical image, there is provided a medical image easy to 
observe with respect to the area of interest. In this case, 
when the luminance of the area except the area of interest 
can arbitrarily be adjusted, a position of the area of 
interest in the entire medical image can be confirmed in 
accordance with the user's liking, and adjustment can be 
performed in such a manner that the area of interest can be 
observed in a concentrated manner. 

Moreover, when the image processing apparatus of the 
present invention is provided with the interested area 
designating section, the apparatus is further provided with a 
part recognizing section for recognizing positions of a 
plurality of parts appearing in one medical image, and the 
image processing section preferably subjects the area of 
interest designated by the interested area designating 
section to the image processing for the part appearing on the 
area of interest among the parts recognized by the part 
recognizing section . 

In this case, when an observer designates the area 
of interest, the observer does not have to designate the 
image processing condition in accordance with the area of 
interest, the image processing is performed on the image 
processing condition suitable for the designated area of 
interest, and operability is enhanced. 
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Moreover , when the image processing apparatus of the 
present invention is provided with the interested area 
designating section , the image display section arranges and 
displays a plurality of medical images, applies the same area 
of interest as the area of interest designated by the 
interested area designating section with respect to one ~ 
medical image among the plurality of medical images displayed 
on the image display section to the plurality of medical 
images , and lowers the luminance of the area except the area 
of interest of each medical image to display the plurality of 
medical images . 

By setting and displaying the same area of interest 
in the plurality of medical images in this manner, it becomes 
easy to compare and examine, for example, a past case with a 
current symptom with respect to the area of interest. 

Furthermore , when the image processing apparatus of 
the present invention is provided with the image display 
section, the apparatus is provided with a scanning processing 
designating section for designating a scanning processing of 
setting the area of interest on the medical image displayed 
in the image display section and moving the area of interest 
in a predetermined direction in response to the operation, 
and 

the image display section preferably displays the 
medical image in which the area of interest successively 
moves , and the luminance of the area except the area of 
interest is lowered in response to designation of the 
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scanning processing by the scanning processing designating 
section . 

Moreover, in this case, the apparatus is provided 
with the part recognizing section for recognizing the 
positions of the plurality of parts appearing in one medical 
image, and the image processing section preferably subjects 
the successively moving area of interest to the image 
processing in accordance with the part appearing in the 
successively moving area of interest among the parts 
recognized by the part recognizing section. 

In this case, the image processing condition does 
not have to be designated, and in response to the movement of 
the area of interest the moved area of interest is displayed 
in an easily observed mode. 

Furthermore, when the image processing apparatus of 
the present invention is provided with the scanning 
processing designating section, for the image display section, 
in response to the designation of the scanning processing by 
the scanning processing designating section, the same area of 
interest is set in the same position at the same timing and 
the plurality of medical images in which the area of interest 
moves synchronously at the same speed are preferably arranged 
and displayed. 

In this case, the symmetry of the human body can be 
observed, for example, in comparison with a past image. 

Moreover, in the image processing apparatus of the 
present invention, the data obtaining section typically 
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obtains a radiation image as one type of the medical image. 

When the image processing apparatus of the present 
invention is specified as an apparatus for handling the 
radiation image, there is provided an image processing 
apparatus for subjecting the radiation image to an image 
processing, comprising: 

an image processing condition storing section for 
storing an image processing condition when the radiation 
image is subjected to the image processing in accordance with 
a photography device type and photography part when the 
radiation image is obtained; 

a data obtaining section for obtaining the radio 
image, and the photography device type and photography part 
when the radiation image is obtained; and 

an image processing section for reading the image 
processing condition for the same photography device type and 
photography part as the photography device type and 
photography part obtained by the data obtaining section from 
the image processing condition storing section, and 
subjecting the radiation image obtained by the data obtaining 
section to the image processing in accordance with the read 
image processing condition . 

Moreover, in order to achieve the aforementioned 
object according to the present invention there is provided 
an image processing method for subjecting a medical image to 
an image processing, comprising steps of: 

storing an image processing condition when the 
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medical image is subjected to the image processing in 
accordance with a photography device type and a photography 
condition when the medical image is obtained; and 

obtaining the medical image, and the photography 
device type and the photography condition when the medical 
image is obtained, and subjecting the obtained medical image 
to the image processing in accordance with the image 
processing condition for the same photography device type and 
photography condition as the obtained photography device type 
and photography condition. 

The image processing method of the present invention 
is a method realized by the image processing apparatus of the 
present invention, and includes modes corresponding to all 
modes of the image processing apparatus of the present 
invention . 

Furthermore, in order to achieve the aforementioned 
object according to the present invention there is provided 
with an image processing program storage medium in which an 
image processing program for operating a computer system as 
an image processing apparatus for subjecting a medical image 
to an image processing is stored, the stored image processing 
program comprising : 

a data obtaining section for obtaining the medical 
image, and a photography device type and a photography 
condition when the medical image is obtained; and 

an image processing section for subjecting the 
medical image obtained by the data obtaining section to the 
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image processing in accordance with an image processing 
condition for the same photography device type and 
photography condition as the photography device type and 
photography condition obtained by the data obtaining section. 

For the image processing program storage medium of 
the present invention, when the stored image processing - 
program is executed by the computer system, the computer 
system is operated as the image processing apparatus of the 
present invention, and modes corresponding to all modes of 
the image processing apparatus of the present invention are 
included. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is an appearance perspective view of a 

personal computer . 

Fig. 2 is a hardware constitution view of the 

personal computer. 

Fig. 3 is a function block diagram of a first 

embodiment of an image processing apparatus of the present 

invention . 

Fig. 4 is a detailed block diagram of an image 
processing section of the image processing apparatus shown in 
Fig. 3. 

Fig. 5 is a schematic view showing one embodiment of 
a storage medium of the present invention. 

Figs . 6A and 6B are explanatory views of a principle 
of a luminance correction processing. 
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Fig. 7 is a flowchart of a luminance correction 
processing program. 

Fig. 8 is a graph showing a luminance correction 
processing curve. 

Fig. 9 is a flowchart showing a convolution 
processing routine. 

Fig. 10 is a flowchart of a gradation processing 

program. 

Fig. 11 is a graph showing a correspondence between 
a pixel value of an original image and the pixel value of a 
gradation conversion image . 

Fig. 12 is a flowchart showing a non- linear 
conversion curve data preparation processing. 

Fig. 13 is a chart showing a frequency coefficient 
showing a degree of frequency emphasis with respect to the 
pixel value of the original image . 

Fig. 14 is a flowchart of a frequency processing 

program. 

Fig. 15 is a flowchart of a histogram analysis and 
window processing program. 

Fig. 16 is a chart showing one example of a 
processing effect by the present embodiment. 

Fig. 17 is a flowchart showing an initial image 
display and showing registration and re-use of an image 
quality parameter for defining an image processing condition. 

Fig. 18 is a diagram showing one example of the 
initial display image . 
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Fig. 19 is a diagram showing an image quality 
adjustment dialog box (gradation processing). 

Fig. 20 is a diagram showing the image quality 
adjustment dialog box (luminance correction processing). 

Fig. 21 is a diagram showing the image quality 
adjustment dialog box (frequency processing). 

Fig. 2 2 is a diagram showing the image quality 
adjustment dialog box (basic processing) . 

Fig. 23 is a diagram showing a masking dialog box. 

Fig. 2 4 is a diagram showing one example of a 
medical image subjected to a masking processing. 

Fig. 2 5 is a diagram showing that two medical images 
are arranged and displayed. 

Fig. 26 is a flowchart of the masking processing. 

Fig. 2 7 is a diagram showing a scanning dialog box. 

Fig. 28 is a diagram showing the medical image 
subjected to a scanning processing. 

Fig. 29 is a flowchart of the scanning processing. 

Fig. 30 is a flowchart of an automatic part 
recognition processing . 

Fig. 31 is an explanatory view of a map data 
preparation processing procedure. 

Fig. 32 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 33 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 34 is an explanatory view of the map data 
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preparation processing procedure. 

Fig. 35 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 36 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 3 7 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 38 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 3 9 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 40 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 41 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 4 2 is an explanatory view of the map data 
preparation processing procedure. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
An embodiment of the present invention will be 
described hereinafter. 

Here, the embodiment constituted by mounting an 
image processing program on a personal computer and operated 
as an image processing apparatus of the present invention 
will be described. Therefore, first the personal computer 
itself will be described, and a processing content executed 
by the personal computer will next be described. 
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Fig. 1 is an appearance perspective view of the 
personal computer, and Fig. 2 is a hardware constitution view 
of the personal computer. 

For an appearance constitution, a personal computer 
100 is provided with: a main body apparatus 110; an image 
display 120 for displaying an image on a display screen 121 
in response to an instruction from the main body apparatus 
110; a keyboard 130 for inputting various information to the 
main body apparatus 110 in response to key operation; and a 
mouse 140 for designating an arbitrary position on the 
display screen 121 to input the instruction, for example, 
corresponding to an icon displayed in the position. In 
appearance, the main body apparatus 110 is provided with a 
floppy disk mounting port 110a for mounting a floppy disk, 
and a CD-ROM mounting port 110b for mounting a CD-ROM. 

As shown in Fig. 2, the main body apparatus 110 
contains therein: a CPU 111 for executing various programs; a 
main memory 112 for developing the program to be executed by 
the CPU 111; a hard disk drive 113 in which various programs 
and data are stored; an FD drive 114, on which a floppy disk 
10 is mounted, for accessing the mounted floppy disk 10; a 
CD-ROM drive 115, on which a CD-ROM 11 is mounted, for 
accessing the mounted CD-ROM 11; an input interface 116, 
connected to a scanner for reading the medical image obtained 
on a medical image obtaining photography device or a film to 
obtain digital data represented by the medical image, for 
receiving the medical image as the digital data; and an 
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output interface 117 for transmitting the medical image 
subjected to an image processing to the outside, and these 
various devices are connected to the image display 120, 
keyboard 130 and mouse 140 also shown in Fig. 1 via a bus 150. 

Fig. 3 is a function block diagram of a first 
embodiment of the image processing apparatus of the present 
invention . 

An image processing apparatus 200 shown in Fig. 3 is 
constituted of the personal computer shown in Figs. 1 and 2, 
data stored in the personal computer and the program operated 
by the personal computer. 

To a data obtaining section 211 of the image 
processing apparatus shown in Fig. 3, medical images such as 
a radiation image, and a photography device type and 
photography condition when the medical image is obtained, 
represented by digital data, are inputted, and the data 
obtaining section 211 generates an object constituted by 
combining the inputted medical image, photography device type 
and photography condition. 

On hardware, the data obtaining section 211 is 
constituted of the input interface 116 shown in Fig. 2, the 
hard disk drive 113 and main memory 112 for storing the 
program to generate the object, the CPU 111 for executing the 
program, and the like. The medical image, photography device 
type and photography condition inputted to the data obtaining 
section 211 and combined and generated as the object are 
inputted to an image processing section 212, and the image 



processing section 212 subjects the medical image to the 
image processing. 

In an image processing condition storing section 218 , 
as partially illustrated in tables 1 to 3, the photography 
5 device type and photography condition and an image processing 
condition are correlated with one another and stored. 

Moreover, in the image processing condition storing 
section 218, in response to the photography device types and 
photography conditions, and even with one photography device 
UP type and one photography condition, the image processing 

S! condition for respective parts (e.g., a lung. field, 

\*i 

e |= mediastinum, rib, heart, diaphragm, and the like) in a chest 

111 

iji simple X-ray image) appearing in the medical image 

III 

I*" photographed by the photography device type and on the 

jl5 photography condition is also stored. 

Fj Furthermore, these image processing conditions can 

jS" be customized for each user (e.g., each doctor or each 

inspecting engineer) . When the customizing is performed, the 
image processing condition for each user is stored in the 

20 image processing condition storing section 218. 

In order to subject the medical image in the object 
sent from the data obtaining section 211 to the image 
processing, the image processing condition for the same 
photography device type and photography condition as the 

25 photography device type and photography condition in the 

object is read, and the image processing section 212 performs 
the image processing in accordance with the image processing 
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condition read from the image processing condition storing 
section 218. In connection to the hardware, the image 
processing section 212 corresponds to the hard disk drive 113 
and main memory 112, shown in Fig. 2, for storing the image 
processing program, and the CPU 111 for executing the image 
processing program, and on the hardware, the image processing 
condition storing section 218 corresponds to the hard disk 
drive 113 for storing a table prepared by combining the 
photography condition with the image processing condition as 
illustrated in the tables 1 to 3 . 

Additionally, here, the medical image before 
subjected to the image processing in the image processing 
section 212 will be referred to as an input image, and the 
medical image after subjected to the image processing will be 
referred to as an output image. 

Contents of the tables 1 to 3 will be described 
belov\ \ 



Table 1 



Photography device 
type 


Device ABC 


Image processing condition 
quality parameter) 


( image 


Photography condition 


Luminance correction 
processing parameter 




Photography part 


cnest 


Mask size (horizontal and 
vertical ) 


41 


Photography 
division 


Simple photography 


Load coefficient 
( weight ) 


0.5 


Posture /direct ion 
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Gradation processing 




Method 
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Point A 
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Point B 
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Point C 
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Point D 
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Point E 
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Point F 
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First load coefficient Wl 


0.4 






Second load coefficient W2 


-0.4 






Frequency emphasis type 


Z 






Lower limit value 


0.000 






Upper limit value 


1 .000 



Table 2 



Photography device 
type 


Device ABC 


Image processing condition 
quality parameter) 


( image 


Photography condition 


Luminance correction 
processing parameter 




rnoioyrapny pan 


tnest 


Mask size (horizontal and 
vertical ) 


41 


Photography 
division 


Simple photography 


Load coefficient 
(weight ) 


0.6 


Posture /direct ion 


Side 


Gradation processing 

pax amc u tsi 




Method 


General 
photography 


Point A 


0.000 




/ 


Point B 


0.029 






Point C 


0. 117 






Point D 


0.260 






Point E 


0.436 






Point F 
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Point H 


n Q TO 






Point I 


1.000 
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vertical ) 








First load coefficient Wl 


0.3 






Second load coefficient W2 


-0.3 






Frequency emphasis type 
Lower limit value 


Z 

0.000 






Upper limit value 


1.000 



Table 3 



Photography device 
type 


Device ABC 


Image processing condition 
quality parameter) 


( image 


Photography condition 


Luminance correction 
processing parameter 




Photography part 


Neck 


Mask size (horizontal and 
vertical ) 


31 


Photography 
division 


Simple photography 


Load coefficient 
(weight ) 


0.3 


Posture /direction 


Side 


Gradation processing 

Cl JL Gil 1 1 C i. ^3 J- 




Method 


General 
photography 


Point A 


0.000 






Point B 


0.110 






Point C 


0.280 






Point D 


0.520 






Point E 


0.740 






Point F 


0 . 850 






Point G 


0 . 912 






Point H 


0 . 960 






Point I 


1 . 000 
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vertical) 








First load coefficient Wl 


0.5 






Second load coefficient W2 


-0.5 






Frequency emphasis type 


F 






Lower limit value 


0.000 






Upper limit value 


1. 000 
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The medical image subjected to the image processing 
in the image processing section 212 (output image) is 
inputted to an image display section 213 , or transmitted to 
the outside via the output interface 117 shown in Fig. 2. On 
the hardware , the image display section 213 corresponds to 
the image display 120 shown in Figs. 1 and 2. 

The medical image displayed in the image display 
section 213, or the medical image transmitted to the outside 
and displayed in the outside is used for diagnosis. The 
displayed medical image is a medical image subjected to the 
image processing by the image processing condition in 
accordance with the photography device type and photography 
condition, and is a preferable image for diagnosis 
irrespective of a medical image type. 

Moreover , in response to the operation , an image 
processing condition operating section 215 changes or deletes 
the image processing condition stored in the image processing 
condition storing section 218, or adds a new image processing 
condition to the image processing condition storing section 
218. 

Furthermore , an interested area designating section 
216 designates a desired area of interest on the medical 
image displayed in the image display section 213 in response 
to the operation . When the interested area designating 
section 216 designates the area of interest , the image 
display section 213 lowers a luminance of an area except the 
area of interest designated by the interested area 
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designating section and displays the medical image. In this 
case, the interested area designating section 216 also 
designates a coefficient indicating a degree of a drop of the 
luminance of the area except the designated area of interest 
in response to the operation, and the image display section 
213 lowers the luminance of the area except the area of - 
interest designated by the interested area designating 
section 216 down to the luminance in accordance with the 
coefficient designated by the interested area designating 
section 216 and displays the medical image. 

Additionally, the image processing apparatus 200 
shown in Fig. 3 is also provided with a part recognizing 
section 214, and the image processing section 212 is provided 
with a function of performing the image processing on the 
image processing condition for the part appearing in the 
designated area of interest when the area of interest is 
designated by the interested area designating section 216. 

Here, the part recognizing section 214 automatically 
recognizes positions of a plurality of parts (e.g., lung 
field, rib, hear, and the like) appearing in one medical 
image (e.g., chest X-ray image). 

Furthermore, the image display section 213 is 
provided with a function of arranging and displaying the 
plurality of medical images. In this case, the image display 
section 213 applies the same area of interest as the area of 
interest designated by the interested area designating 
section 216 with respect to one medical image among the 
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plurality of medical images displayed in the image display 
section 213 to the plurality of medical images, and lowering 
the luminance of the area except the area of interest of each 
medical image to display the plurality of medical images . 

Additionally, the image processing apparatus shown 
in Fig. 3 is also provided with a scanning processing 
designating section 217. The scanning processing designating 
section 217 designates a scanning processing of setting the 
area of interest (typically a slit -shaped area of interest 
extending in a transverse or vertical direction) on the 
medical image displayed in the image display - section 213 to 
move the area of interest in a predetermined direction (e.g., 
the vertical direction for a slit extending in the transverse 
direction) in response to the operation. 

When the scanning processing designating section 217 
designates the scanning processing, the image display section 
213 displays the medical image constituted by successively 
moving the area of interest set by the scanning processing 
designating section 217 and lowering the luminance of the 
area except the area of interest. In this case, depending on 
a mode of designation by the scanning processing designating 
section 217, the image processing section 212 subjects the 
successively moving area of interest to the image processing 
in accordance with the part appearing in the successively 
moving area of interest among the parts recognized by the 
part recognizing section 214. 

The image display section 213 sets the same area of 
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interest in the same position at the same timing in response 
to the designation of the scanning processing by the scanning 
processing designating section 217, and can arrange and 
display the plurality of medical images whose areas of 
interest move synchronously with one another at the same 
speed. 

Fig. 4 is a detailed block diagram of the image 
processing section 212 in the image processing apparatus 
shown in Fig . 3 . 

In the image processing section 212, a luminance 
correction processing 2121, a gradation processing 2122, a 
frequency processing 2123, and a histogram analysis and 
window level processing 2124 are executed. Details of these 
processings will be described later. 

Additionally, when the image processing is performed 
with respect to the area of interest designated by the 
interested area designating section 216 or the area of 
interest of the scanning processing designated by the 
scanning processing designating section 217, the histogram 
analysis and window level processing 2124 fails to be 
executed. 

These are measures taken to display the area of 
interest entirely in a low luminance state when the luminance 
of the entire area of interest is low, and to display the 
area of interest entirely in a high luminance state when the 
luminance of the entire area of interest is high. 

Fig. 5 is a diagram showing one embodiment of an 
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image processing program storage medium of the present 
invention . 

For an image processing program storage medium 300 
shown in Fig. 5, for example, the hard disk drive 113, CD-ROM 
11 and floppy disk 10 shown in Fig. 2 in a state in which an 
image processing program 310 is stored are representatively 
shown, and in the image processing program storage medium 300 
the image processing program 310 constituted of a data 
obtaining section 311, an image processing section 312, an 
image display section 313, a part recognizing section 314, an 
image processing condition operating section 315, an 
interested area designating section 316, and a scanning 
processing designating section 317 is stored. 

The image processing program storage medium 300 is, 
for example, the CD-ROM 11 shown in Fig. 2 and placed in the 
state in which the image processing program 310 is stored, 
and in this case, the CD-ROM corresponds to one embodiment of 
the image processing program storage medium of the present 
invention. When the image processing program 310 stored in 
the CD-ROM 11 is read by the CD-ROM drive 115, installed in 
the hard disk drive 113, and further executed by the CPU 111, 
the personal computer 100 shown in Figs. 1, 2 operates as one 
embodiment of the image processing apparatus of the present 
invention. The hard disk drive 113 in which the image 
processing program 310 is installed also corresponds to one 
embodiment of the image processing program storage medium of 
the present invention. When the image processing program 310 



installed In the hard disk drive 113 is downloaded to the 
floppy disk 10 by the FD drive 114, the floppy disk in which 
the image processing program is stored also corresponds to 
one embodiment of the image processing program storage medium 
of the present invention. 

Here, the data obtaining section 311, image 
processing section 312, image display section 313, part 
recognizing section 314, image processing condition operating 
section 315, interested area designating section 316, and 
scanning processing designating section 317 constituting the 
image processing program 310 shown in Fig. 5 correspond to 
the data obtaining section 211, image processing section 212, 
image display section 213, part recognizing section 214, 
image processing condition operating section 215, interested 
area designating section 216, and scanning processing 
designating section 217 constituting the image processing 
apparatus 200 shown in Fig. 3, respectively. Additionally, 
the respective devices of the image processing apparatus 200 
of Fig. 3 refer to a combination of the hardware of the 
personal computer 100 shown in Figs. 1, 2 with software 
executed in the hardware. For the respective devices 
constituting the image processing program 310 shown in Fig. 5, 
even when the same names are used, only an application 
program portion is referred to among the hardware and 
software . 

Fig. 6 is an explanatory view of a principle of the 
luminance correction processing. Fig. 6A shows a state before 
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the luminance correction processing, and Fig. 6B shows a 
state after the luminance correction processing. The 
abscissa of Figs. 6A, 6B indicates a place of an image 
divided by an image density (lung field, mediastinum, 
diaphragm, and the like for the chest image), and the 
ordinate indicates a gradation value of the image. As seen 
from Fig. 6, with respect to a portion with a small gradation 
change, the image state before the processing (image 
gradation change state) is kept, and by narrowing a dynamic 
range only with respect to a portion with a large gradation 
change, an image can be obtained in which contrast fails to 
be visually lowered. 

A basic algorithm of the luminance correction 
processing for use herein is newly realized for medical image 
diagnosis by referring to a convolution algorithm 
internationally standardized by Part 2 Programmer's imaging 
kernel system application program interface of ISO/IEC 12087- 
2 Image Processing and Interchange (IPI). 

Fig. 7 is a flowchart of a luminance correction 
processing program for executing the luminance correction 
processing 2121 in the image processing section 212 shown in 
Fig. 4. 

First in a step a, they f ollowings are inputted into 
the program: \ 

original image: S (x, y, V, t, b); 
impulse response array H(x\ y); and 
load coefficient weight. \ 
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Among these, the impulse response array H(x, y) and the load 
coefficient weight are image processing conditions for the 
original image S(x, y, z , t , \b ) . 

Here, the original image S(x, y, z, t, b) denotes an 
image before the processing is executed ( here , an image 
before a convolution processing is executed), and x, y, z, t, 
b of the original image S(x, y, z, t, b) denote a horizontal 
direction position, vertical direction position, depth, time, 
and band, respectively- Additionally, z (depth) denotes a 
case in which three-dimensional information obtained by MRI 
or the like is handled, t (time) denotes a case in which time 
information ( dynamic image ) of ultrasonic wave , endoscope or 
the like is handled, and b (band) denotes distinction of R, G 
B , for example , when an image of three colors R , G , Bis 
handled. 

Moreover, the impulse response array H(x, y) denotes 
a mask provided with a uniform value here, and this array 
size (mask size) determines a frequency to be emphasized most 
among frequency components of the image . Specifically, when 
a large size mask is used, the image of low frequency 
components is emphasized. Conversely, when a small size mask 
is used, the image of high frequency components is emphasized 

By changing an unclear mask size in this manner, a 
frequency band important for diagnosis is emphasized, and a 
diagnosis image suitable for diagnosis purpose can be formed. 

For the chest image , the array size (mask size ) 
applied in the luminance correction processing was set to a 



mask size by which a low frequency component image following 
changes of rough structures such as the lung field and 
mediastinum film is emphasized. 

The load coefficient weight is a constant indicating 
a degree of luminance correction. 

Moreover, in step al of Fig. 7 , it is inputted by an 
operation of an operator whether or not to perform an image 
boundary processing in convolution performed in step a4 . 
Also for the image boundary processing, instead of an 
operator's inputting for each time, the processing is stored 
beforehand one of the image processing conditions for the 
photography condition, and presence/absence of the image 
boundary processing as one of the image processing conditions 
may be inputted to the luminance correction processing 
program. 

In step a2 , a luminance correction image D(x, y # z, 
t, b) , filter image A(x, y, z, t, b), and luminance 
correction coefficient curve DRT are generated. In this step 
a2 , with respect to the luminance correction image D(x, y, z, 
t, b), and the filter image A(x, y, z, t, b) , only the array 
(area) is secured. 

Table 4 is a table showing a luminance correction 
coefficient table, and Fig. 8 is a chart showing a luminance 
correction curve. 



Table 4 



Image gradation value point 


DRT value 


0.000 *image maximum pixel value 


0.500 *image maximum pixel value 


0.304 *image maximum pixel value 


0.091 *image maximum pixel value 


0.322 *image maximum pixel value 


0.070 *image maximum pixel value 


0.339 *image maximum pixel value 


0.053 *image maximum pixel value 


0.356 *image maximum pixel value 


0.03 8 *image maximum pixel value 


0.374 *image maximum pixel value 


0.024 *image maximum pixel value 


0.391 *image maximum pixel value 


0.015 *image maximum pixel value 


0.409 *image maximum pixel value 


0.008 *image maximum pixel value 


0.500 *image maximum pixel value 


0.000 *image maximum pixel value 


1.000 *image maximum pixel value 


0.000 *image maximum pixel value 



The luminance correction coefficient table shown in 
Table 4 is stored beforehand, and in step a2 of Fig. 7 by 
linearly interpolating between respective values of the 
luminance correction coefficient table, a luminance 
correction coefficient curve DRT is generated as shown by a 
solid line of Fig 8. The abscissa of the luminance 
correction coefficient curve shown in Fig. 8 indicates an 
image gradation value (normalized density of each point), and 
the ordinate indicates an DRT value indicative of a degree of 
luminance correction. Additionally, a dashed line shown in 
Fig 8 shows another luminance correction coefficient curve. 

It is judged in step a3 of Fig. 7 whether or not the 
processing of the next steps a4 , a5 ends with respect to the 
whole area of the image. When the processing has not ended 
yet with respect to the whole area, the next one pixel is 
subjected to the processing of the steps a4 , a5 . When the 
processing of the steps a4, a5 has ended with respect to the 



- 34 - 



whole area of the image, this luminance correction processing 
ends . 

In the step a4 , the convolution processing is 
performed with respect to one pixel noted at present. 
In step a4 , 

A(x, y, z, t, b) = S(x, y, z, t, b)(*)H(x, y) 

... (1) 

indicates a processing of setting an average value of pixel 
values in an area of H(x, y) centering on one pixel noted at 
present anew as the pixel value of one noted pixel, and the 
filter image A(x, y, z, t, b) becomes a blurred image with a 
reduced high frequency component by the aforementioned 
calculation . 

In the step a5, the luminance correction processing 
is performed with respect to one pixel noted at present. In 
step a5, for 

D(x, y, z, t, b) = S(x, y, z, t, b) 

+ weight*DRT{A(x, y, z, t, b)} ... (2), 
DRT{A(x, y, z, t, b)} indicates a DRT value (see Fig. 8) for 
the pixel value of the filter image A(x, y, z, t, b) of the 
presently noted pixel, and the equation (2) means that the 
DRT value weighted by the coefficient weight is added to the 
pixel value of the same pixel of the original image S(x, y, z, 
t, b). By employing the DRT curve shown by a solid line in 
Fig. 8 in this manner, the luminance correction processing 
shown in Fig. 6 is realized. In the luminance correction 
processing shown in Fig. 6, the luminance of a high luminance 
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(whitish) portion is lowered, but by employing the DRT curve 
shown by the dashed line of Fig. 8, the luminance of a low 
luminance (blackish) portion is raised. 

Fig. 9 is a flowchart showing a convolution 
processing routine in the step a4 of Fig. 7. 

In step bl, an image boundary determination is 
performed. Specifically, when the mask H(x, y) is superposed 
on the original image centering on the presently noted one 
pixel, it is judged whether or not a portion of the mask H(x, 
y) is out of an original image end. 

When the mask fails to overlap (fails to stick out 
of) a boundary, the processing advances to step b2 to judge 
whether or not the processing of step b3 is performed with 
respect to the whole area of the mask H(x, y) , in step b3 the 
original image S(x, y, z, t, b) is multiplied by the mask H(x 
y) for each pixel with respect to the whole area of the mask 
H(x, y) and a multiplication result is accumulated as the 
value of one presently noted pixel of the filter pixel A(x, y 
z, t, b) . 

When accumulation ends with respect to the whole 
area of the mask H(x # y) , the processing advances to step b8 
to perform a scale factor processing of returning the 
accumulated value obtained by accumulation back to the 
average value with one pixel, and the convolution routine is 
exited. 

In the step bl, it is determined that the mask H(x, 
y) sticks out of the boundary of the original image S(x, y, z, 
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t, b) with respect to the presently noted one pixel, then the 
processing advances to step b4 , and it is judged in the step 
b4 whether or not performing of a boundary processing is 
designated. When no boundary processing is performed, the 
processing advances to step b9 , the pixel value of the 
original image is employed as it is as the pixel value of the 
filter image with respect to the presently noted one pixel, 
and the convolution processing routine is exited. 

When it is determined in the step b4 that the 
boundary processing is performed, the processing advances to 
step b5 to judge whether or not the next two steps b6, b7 end 
with respect to the whole area of the mask H(x, y) . 

In the step b6 the boundary processing is performed, 
and in the step b7 accumulation is performed similarly as the 
step b3 with respect to the image subjected to the boundary 
processing . 

A boundary processing method employed in the step b6 
is realized by referring to a reflected exterior mode 
algorithm of convolve_2d internationally standardized by Part 
2 Programmer's imaging kernel system application program 
interface of ISO/IEC 12087-2 Image Processing and Interchange 
(IPI). The boundary processing is a processing of turning 
back the pixel value in the so-called original image boundary 
in such a manner that linear symmetry is obtained, and 
increasing the pixel to the outside of the boundary of the 
original image. 

When the accumulated value is obtained with the 
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presently noted one pixel in the step b5 , the processing 
advances to step t>8 , and the average value is obtained in the 
step b8 . 

The blurred filter image A(x, y, z, t, b) is 
generated as the image as described above . 

Additionally, it is determined whether or not to* 
perform the boundary processing on the basis of whether or 
not the image including meaningful information spreads to a 
peripheral edge area of the original image . When the 
meaningful information spreads to the peripheral edge area, 
even with much time required for the image processing, it is 
preferable to perform the boundary processing. When there is 
little meaningful information in the peripheral edge area, it 
is preferable to omit the boundary processing and shorten the 
time required for the image processing. 

Fig. 10 is a flowchart of a gradation processing 
program for executing the gradation processing 2122 in the 
image processing section 212 shown in Fig. 4. 

In step cl, the original image (image before the 
gradation processing) S(x, y, z, t, b) , and non-linear 
conversion curve data LOOK{> are inputted. The non-linear 
conversion curve data LOOK{ } is a lookup table prepared as 
described later based on a gradation processing parameter 
(points A to I) of the image processing condition (refer to 
Tables 1 to 3) . 

In step c2, a gradation processing image D(x, y, z, 
t, b) is formed. Additionally, this means that the area for 
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the gradation processing image is secured, and respective 
pixel values of the gradation processing image are prepared 
in step c4. 

It is judged in step c3 whether or not the 
processing of the step c4 ends over the whole range of the 
image, and when the processing has not ended yet, the 
processing of the step c4 is performed for each pixel. 

In the step c4 # the non-linear conversion curve data 
LOOK{ } of the lookup table form is referred to and conversion 
of each pixel value is performed. 

Fig. 11 is a graph showing a correspondence between 
the pixel value of the original image and the pixel value of 
a gradation conversion image. 

with respect to the original image (abscissa), from 
0.0 (minimum density) to 1.0 (maximum density), nine points 
(points A to I ) are taken at equal intervals, and for the 
gradation conversion image (ordinate), the gradation 
processing parameter (points A to I ) of the image processing 
condition is applied to each point. When these nine points 
are smoothly connected by a spline curve, the non-linear 
conversion curve data LOOK{ } is formed. The spline curve is 
realized by referring to the algorithm of a scroll periodic 
spline curve of "Scientific Technical calculated by revised C 
published by CQ Company and authored by Shinichi Koike." 

Fig. 12 is a flowchart showing a non-linear 
conversion curve data preparation processing. 

First in step dl , coordinate values of nine points 




(points A to I ) of x-axis (original image) and y-axis 
(gradation conversion image), and a division interval value 
between data are inputted, and the storage area LOOK{ } of the 
non-linear conversion curve data is secured. 
5 In order to prepare the spline curve, since 

different processings are necessary in both ends and middle, 
in step d2 the non-linear conversion curve data of a first 
division (between the points A and B) is generated, in step 
d3 the non-linear conversion curve data of a middle division 
W (between the points B and H) is generated, and in step d4 the 
■ "l non-linear conversion curve data of the last division 

% (between the points H and I) is generated. 

In step cl of Fig. 10, the non-linear conversion 

-.LI 

iy curve data LOOK{} prepared beforehand in this manner is 

tf5 inputted, or in the step cl the non- linear conversion curve 

H data LOOK{ } is prepared. 

p The frequency processing 2123 in the image 

processing section 212 shown in Fig. 4 will next be described. 
Fig. 13 is a chart showing a frequency coefficient 

20 showing a degree of frequency emphasis with respect to the 
gradation value of the original image. 

A frequency emphasis type F means that a frequency 
coefficient is always 1.0 irrespective of the gradation value 
of the original image, a frequency emphasis type Z means that 

25 with a larger gradation value of the original image (with a 

higher image density (with a lower luminance) ) , the frequency 
emphasis is performed more strongly, and a frequency emphasis 
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type Y means that with a smaller gradation value of the 
original image (with a lower image density (with a higher 
luminance)), the frequency emphasis is performed more 
strongly. As shown in Tables 1 to 3, the frequency emphasis 
type is designated as one of the image processing conditions. 

Additionally, lower and upper limit values of an. 
original image density area (luminance area) for performing 
frequency emphasis can be set as shown by a dashed line Z ' of 
Fig. 13, and the frequency emphasis is performed only in the 
area held between the lower limit value and the upper limit 
value . 

Fig. 14 is a flowchart of a frequency processing 

program. 

First in step el, 

original image (image before a frequency processing) 
S(x, y, z, t, b), 

impulse response array (uniform mask herein) H(x, y) , 
load coefficients Wl . , W2 , 

frequency emphasis type (any one of F, V, Z), and 
an instruction as to whether or not to perform a 
convolution image boundary processing are inputted. Among 
these, the impulse response array H(x, y) is designated as a 
mask size in the image processing condition, and the load 
coefficients Wl , W2 and frequency emphasis type are also 
designated as the image processing conditions. 

The convolution image boundary processing is 
optional here, and is constituted in such a manner that an 
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operator gives an instruction for each image processing, but 
designation of whether or not to perform the image boundary 
processing may be designated beforehand as one of the image 
processing conditions . 



processing (frequency processing image) D(x, y, z, t, b) r low 
pass filter image A(x, y # z, t, b) , and frequency emphasis 
coefficient table RT are generated. With respect to the 
frequency processing image D(x, y, z, t, b) and low pass 
filter image A(x, y, z, t, b) , it is meant that in the step 
e2 an area for storing the images are secured, and actual 
data is prepared in steps e4, e5. The frequency emphasis 
coefficient table RT is formed by obtaining the coefficients 
for respective gradation values with respect to the frequency 
emphasis type (e.g., frequency emphasis type Z for Table 1) 
designated in accordance with the image processing condition 
among some frequency emphasis types F, Y , Z shown in Fig. 13 
and arranging data in a table form. 



processing of steps e4, e5 to be performed for each pixel 
ends with respect to the whole range of the image , and the 
processing of the steps e4, e5 is performed for each pixel 
with respect to the respective pixels in the whole range . 



already been described with reference to Fig. 9, and 
redundant description is omitted here. As a result of 
convolution, so-called blurred image A(x, y, z, t, b) with a 



In step e2, the image subjected to the frequency 



It is judged in step e3 whether or not the 



The step e4 corresponds to convolution, and has 



• .... • 



reduced high frequency component is formed. 

In step e5, the frequency processing is performed in 
accordance with: 

D(x, y, z, t, b) = S(x, y, z, t, b) 
+ (Wl*RT[S(x, y, z, t, b)]*S(x, y, z, t, b) 
+ W2*RT[S(x, y, z, t, b)]*A(x, y, z, t, b) 

... (3) 

In this equation (3) RT[S(x, y, z, t, b)] is a 
frequency coefficient (ordinate of Fig. 13) corresponding to 
the pixel value (abscissa of Fig. 13) of the original image 
S(x, y, z, t, b) of the presently noted pixel. 

In the equation (3) WT*RT[S(x, y, z, t, b)]*S(x, y, 
z, t # b) means that RT[S(x, y, z, t, b)] obtained as 
described above is multiplied by the load coefficient Wl , and 
further multiplied by the pixel value of the original image 
S(x, y # z, t, b) of the noted pixel. 

Moreover, similarly, in the equation (3) W2*RT[S(x, 
y, z, t # b)]*A(x, y, z, t, b) means that RT[S(x, y, z, t, b)] 
is multiplied by the load coefficient W2 , and further 
multiplied by the pixel value in the low pass filter image 
A(x, y, z, t, b) of the noted pixel. 

Therefore the equation (3) means that Wl*RT[S(x, y, 
z_. t, b)]*S(x, y, z, t r b) and W2*RT[S(x, y, z, t, b)]*A(x, y, 
z, t, b) are added to the pixel value of the noted pixel of 
the original image S(x, y, z, t, b). Here, the load 
coefficient W2 is provided with a minus value, and the 
equation (3) is therefore a calculation equation for reducing 
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the blurred image component (low frequency component) to 
emphasize the high frequency component. 

Here, when the frequency processing is performed 
only with constants Wl , W2 without using an idea of the 
frequency emphasis type, emphasis is performed with respect 
to the whole density area at a fixed proportion, but with the 
chest image, a noise is amplified in the low density areas 
such as the mediastinum and diaphragm to inhibit image 
diagnosis, or in the lung field a lung tigroid or another 
normal structure is probably incorrectly diagnosed as an 
abnormal observation by excessive emphasis. Therefore, here, 
the defect is removed by introducing the idea of the 
frequency emphasis type. 

The histogram analysis and window processing 2124 in 
the image processing section 212 shown in Fig. 4 will next be 
described. 

Fig. 15 is a flowchart of a histogram analysis and 
window processing program. 

Here, first in step fl, the original image (image 
before this processing is performed) S(x, y, z, t, b) is 
inputted, and in step f2, histogram analysis of the original 
image is performed to detect maximum and minimum pixel values 
and based on the values a window width (maximum pixel value - 
minimum pixel value) width, and center value ((maximum pixel 
value + minimum pixel value) /2) center are calculated. 

In step f3, density conversion processing image D(x, 
y, z, t, b) and density conversion table LOOK{ } are generated 
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Additionally , this step f 3 means that the area for storing 
these is secured, and actual data is prepared for the density 
conversion table LOOK{ } in step f 5 and for the density 
conversion processing image D(x, y , z , t, b) in step f 7 . 

It is judged in step f4 whether or not a window 
level processing in step f5 ends with respect to the whole 
density range , and when the processing has not end yet, the 
density conversion table LOOK{e} of the lookup table form is 
successively prepared for each density in accordance with 
the following : 

LOOK{e> = (e/width - center /width +0.5) 

*d_MAX ... ( 4 ) 

For this density conversion table LOOK{ } , for 
example , when the original image S ( x , y, z , t , b) is 
displayed in the display screen 121 of the image display 120 
shown in Fig. 1, the maximum density of the original image is 
converted to the maximum density (minimum luminance) d_MAX 
which can be represented on the image display screen 121, and 
the minimum density of the original image is converted to the 
minimum density (maximum luminance) 0.0 which can be 
represented on the density screen 121 . 

In step f5, the density conversion table LOOK{ } is 
successively prepared for each density value, and the 
processing ends with respect to the whole density range and 
then advances to step f6. 

It is monitored in the step f6 whether or not the 
density conversion processing of step f7 ends with respect to 
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the whole pixel range of the original image . When the 
processing has not ended yet, the processing advances to the 
step f7. The density conversion table LOOK{} is referred to 
for each pixel and the original image S(x, y, z, t, b) is 
converted to the density conversion processing image D(x, y, 
z , t , b) . 

The density conversion processing image D(x, y, z, t, 
b) prepared in this manner is outputted from the image 
processing section 212 shown in Figs. 3, 4 as an output image, 
and the output image is inputted, for example, to the image 
display section 213 shown in Fig. 3, and displayed/outputted, 
for example, on the display screen 121 shown in Fig. 1 as the 
image for diagnosis. 

Here, as described above, by performing the image 
processing based on the image processing condition in 
accordance with the photography device type and photography 
condition of the medical image as described above, the output 
image superior in diagnosis aptitude can constantly be 
obtained irrespective of the medical image type. 

Fig. 16 is a chart showing one example of a 
processing effect according to the present embodiment. 

Here, 23 cases in total of 15 cases of lung node 
patients (abnormal people) and 8 cases of normal patients in 
CR chest images were used and a radiography specialist of a 
radiation department experimented a digital image subjected 
to the image processing using the film and the present 
invention by a receiver operating characteristic 
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analysis/evaluation method. 

Fig. 16 is a chart showing the experiment result. A 
way of looking at Fig. 16 will be described. 

Y-axis (TPF) of Fig. 16: a ratio at which 
5 abnormality is correctly judged as presence of abnormality. 

X-axis (FPF) of Fig. 16: a ratio at which normality 
is incorrectly judged as presence of abnormality. 

It is assumed by Fig. 16 that the closer an ROC 
curve approaches TPF = 1.0, FPF = 0.0, the better the 
flJO characteristic becomes. In an ideal state, presentation of 
SI abnormality is necessarily judged as the presence of 

41 abnormality, presentation of normality is necessarily judged 

I 

if) as the presence of normality, and the abnormality can 

fij 

I completely be distinguished from the normality. 

s!5 Moreover, Az in Fig. 16 is an area below the ROC 

G curve , and Az equals 1 . 0 with TPF = 1.0, FPF = 0.0. 

]zi Therefore, from the result of Fig 16, as compared 

with the film, the digital image subjected to the image 
processing using the present embodiment obtains a better 

20 result in diagnosis ability, abilities to extract a fine 

structure of a lung blood vessel and a mediastinum structure 
are enhanced, and an ability to detect a pathological change 
is effectively enhanced. 

A mode of the basic image processing in the image 

25 processing section 212 of the image processing apparatus 200 
shown in Fig. 2 has been described above, and modes of 
various operations and displays in the image processing 
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apparatus 200 will be described hereinafter. 

Fig. 17 is a flowchart showing registration and 
reuse of an image quality parameter for defining an image 
initial display and image processing condition. 

Here, first the original image as a processing 
object (input image described with reference to Fig. 3) and 
the photography device type and photography condition when 
the original image is obtained are inputted (step gl). As 
described above, the original image and the photography 
device type and photography condition form one object. In 
the hard disk drive 113 of Fig. 2, a large number of objects 
are stored, and here the user opens a graphic user interface 
(GUI) screen (not shown) in which a list of objects is 
displayed to select a desired object on the screen. 

In this manner, the object is read from the hard 
disk drive 113 and inputted into a routine shown in Fig. 17. 
Additionally, it is assumed here that only one object is 
selected, but a plurality of medical images are arranged and 
displayed simultaneously, for example, as shown in Fig. 25, 
and in this case the plurality of arranged and displayed 
objects are selected. 

Moreover, when entering the routine, user 
authentication is performed by inputting a password or the 
like, and the image processing apparatus is also provided 
with information on the user . 

In the image processing condition storing section 
218 of the image processing apparatus 200 shown in Fig. 3, 
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image quality parameters for determining a large number of 
image processing conditions are stored. In the image 
processing condition storing section 218, as described above, 
in addition to the image processing conditions (image quality 
parameters) for the photography device types and photography 
conditions, a large number of image processing conditions 
(image quality parameters) such as image processing 
conditions for one photography device type and photography 
condition and for a plurality of parts appearing in one 
medical image (e.g., lung field, mediastinum, rib, heart, 
diaphragm, and the like in the chest simple radiograph) are 
associated with the respective users and stored. 

In step g2 of Fig 17, from a large number of image 
quality parameters (image processing conditions), the image 
quality parameter as an initial value associated with the 
user using the image processing apparatus 200 (refer to Fig. 
3) and the photography device type and photography condition 
in the object inputted in the step gl or the image quality 
parameter employed in the past is extracted, in step g3 the 
original image in the object inputted in the step gl is 
subjected to an image quality adjustment processing (image 
processing) in accordance with the image quality parameter 
extracted in the step g2, and in step g4 an initial image 
after the image quality adjustment processing (image 
processing) is displayed. Here, the image quality adjustment 
processing (image processing) includes various processings 
described with reference to Fig. 4. 



Subsequently, when there is an unsatisfactory 
respect in the quality of the displayed medical image, the 
image quality parameter is adjusted to perform the image 
quality adjustment processing (step g5), and a processing of 
5 registering a finally obtained optimum image quality 

parameter is performed (step g6). Thereby, the image quality 
parameter optimum for the user is associated with the 
photography device type and photography condition and with 
the user and registered. 
10 Fig. 18 is a diagram showing one example of the 

0 initial display image displayed in the step g4 of Fig. 17. 
HI This image is displayed on the display screen 121 of the 
s p image display 120 shown in Fig. 1 by the image display 

rU 

*!) section 213 of the image processing apparatus 200 shown in 

1 A* 

15 Fig. 3. 

Here, displayed are a chest front simple radiograph, 
and buttons of "file (F)", "image (I)", and "tool (T)" above 
■Si the radiograph, to which a click operation by a mouse is 

performed. 

20 When mouse-clicking the button "file (F)", a button 

"exit (X)" is displayed. The button "exit (X)" means the end 
of this application, and by mouse-clicking the button "exit 
(X)", an end confirmation message box is displayed. 

By clicking the button "image (I)", an image quality 
25 adjustment dialog box is displayed. Details of the image 
quality adjustment dialog box will be described later. 

When the button "tool (T)" is clicked, buttons 
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"scanning processing (S)" and "masking (M)" are displayed. 
When the button "scanning processing (S)" is mouse-clicked, a 
scanning dialog box is displayed. On the other hand, by 
clicking the button "masking (M)", a masking dialog box is 
displayed. Details of the scanning dialog box and masking 
dialog box will be described later. 

The image quality dialog box is provided with tags 
"gradation processing", "luminance correction processing", 
"frequency processing", and "basic processing". For Figs. 19 
to 22, Fig. 19 shows a screen displayed by mouse-clicking the 
tag "gradation processing", Fig. 20 shows a screen displayed 
by mouse-clicking the tag "luminance correction processing", 
Fig. 21 shows a screen displayed by mouse-clicking the tag 
"frequency processing", and Fig. 22 shows a screen displayed 
by mouse-clicking the tag "frequency processing" "basic 
processing" . 

The "gradation processing" is a screen for adjusting 
the image quality parameter (gradation processing parameter; 
see Tables 1 to 3) for the gradation processing, "luminance 
correction processing" is a screen for adjusting the image 
quality parameter (luminance correction processing parameter; 
see Tables 1 to 3) for the luminance correction processing, 
"frequency processing" is a screen for adjusting the image 
quality parameter (frequency parameter; see Tables 1 to 3) 
for the frequency processing, and "basic processing" is a 
screen for the basic processing (preset selection) . 

In the screen for adjusting the "gradation 



processing" shown in Fig. 19, a curve 501 showing a 
correspondence between the pixel value of the original image 
( image before the gradation conversion processing here ) and 
the pixel value of the gradation conversion processing image 
also shown in Fig . 11 , and a histogram 502 of the pixel value 
of the original image are displayed, and on the right side a 
combo box 503 for adjusting the value of the curve 501 
(points A to I) is displayed. By inputting a numeric value 
directly into the combo box 503 for adjusting the value, or 
mouse-clicking mark "A" "V" for adjusting the value, the 
value is adjusted. Alternatively, by picking and vertically 
moving the respective points A to I of the curve 501 , the 
numeric value is displayed in the value adjusting combo box 
503 and the curve 501 is changed to a curve in accordance 
with the numeric value. 

By adjusting the curve 501 in this manner and 
clicking an "update" button 504, the original image (original 
image inputted in the step gl of Fig. 17) of the displayed 
medical image (see Fig. 18) is subjected to a series of image 
quality adjustment processings including the gradation 
processing in which the gradation processing parameter after 
the adjustment is reflected, and the displayed medical image 
(see Fig. 18) is replaced with the medical image after this 
present image quality adjustment. The user can therefore 
confirm an influence of this parameter adjustment on the 
display image. 

Fig. 19 further shows an "initialize" button 505, 



"new storage" button 506, "storage" button 507, and "exit" 
button 508, and these buttons will be described later in 
detail . 

Fig. 20 shows the screen displayed by mouse-clicking 
the tag "luminance correction processing". 

Fig. 20 only shows the tag "luminance correction 
processing", and omits but shows the respective tags "basic 
processing", "frequency processing", and "gradation 
processing" similarly as Fig. 19, and also shows the 
respective buttons 505 to 508 of "initialize", "new storage", 
"storage", "exit" in a bottom similarly as Fig. 19. 

In the screen of Fig. 20, a parameter adjusting 
combo box 511 and type selecting combo box 512 appear, and in 
the parameter adjusting combo box 511 the load coefficient 
(0.0 to 10.0) and mask size (3 to 127) are adjusted. The 
load coefficient indicates a value of coefficient weight of 
the equation (2) used in the description of the luminance 
correction processing, and the mask size indicates the size 
of H(x, y) appearing in the equation (1). 

Moreover, in the type selecting combo box 512, any 
curve shown in Fig. 8 (a solid- line curve and a dashed- line 
curve are shown here) is selected. 

By mouse-clicking an "update" button 514, the 
original image inputted in the step gl of Fig. 17 is 
subjected to the image quality adjustment processing in which 
the presently adjusted parameter for the luminance correction 
processing is reflected, and instead of the displayed medical 
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image shown in Fig. 18, the medical image subjected to the 
presently newly performed image quality adjustment processing 
is displayed. 

Fig. 21 shows a screen displayed by mouse-clicking 
the tag "frequency processing", and in these screens, the 
parameter for the frequency processing is adjusted. 

Fig. 21 only shows the tag "frequency processing^, 
and omits similarly as Fig. 20 but shows the respective tags 
"basic processing", "luminance correction processing", and 
"gradation processing" similarly as Fig. 19, and also shows 
the respective buttons 505 to 508 of "initialize", "new 
storage", "storage", "exit" in the bottom similarly as Fig. 
19. 

In the screen of Fig. 21, a parameter adjusting 
combo box 521, type selecting combo box 522, and upper and 
lower limit value adjustment columns 5 23 appear, and in the 
parameter adjusting combo box 521 the load coefficient (-10.0 
to 10.0) and mask size (3 to 127) are adjusted. The load 
coefficient indicates values of coefficients Wl , W2 
(additionally W2 = -Wl) of the equation (3) used in the 
description of the frequency processing, and the mask size 
indicates the size of the impulse response array H(x, y) . 

Moreover, the type selecting combo box 522, any 
frequency emphasis type is selected from a plurality of 
frequency emphasis types shown in Fig. 13, and in the upper 
and lower limit value adjustment columns 523, the lower limit 
value (Lower) and upper limit value (Upper) to which the 
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selected frequency emphasis type is applied are adjusted. 

By mouse-clicking an "update" button 524, the 
original image inputted in the step gl of Fig. 17 is 
subjected to the image quality adjustment processing in which 
the presently adjusted parameter for the frequency processing 
is reflected, and instead of the displayed medical image 
shown in Fig. 18, the medical image subjected to the 
presently newly performed image quality adjustment processing 
is displayed. 

Fig. 22 shows the screen displayed by mouse-clicking 
the tag "basic processing", and in these screens the buttons 
common with the respective tags are arranged. 

Fig. 22 only shows the tag "basic processing" for 
reasons similar to those of Figs. 20, 21, also shows the 
respective tags of "frequency processing", "luminance 
correction processing", and "gradation processing" similarly 
as Fig. 19, and also shows the respective buttons 505 to 508 
of "initialize", "new storage", "storage", "exit" in the 
bottom. 

In the screen of Fig. 22, a photography condition 
selecting combo box 531 and parameter adjusting combo box 532 
are displayed. In the photography condition selecting combo 
box 531 the photography condition is selected, and in the 
parameter adjusting combo box 532 the image quality is 
selected. The "image quality" is here associated with a 
plurality of parts (e.g., lung field, mediastinum, rib, heart, 
diaphragm, and the like) appearing in one medical image (e.g.. 
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the chest X-ray image). 

When clicking a "delete" button 533, the parameters 
of the gradation processing, luminance correction processing, 
and frequency processing concerning the part selected by the 
parameter adjusting combo box 532 are deleted. 

Moreover, by clicking an "update" button 534, the 
medical image subjected to the image quality adjustment 
processing by the presently set image quality parameter is 
displayed . 

Here, the respective update buttons 504, 514, 524, 
534 of Figs. 19 to 22 constitute the same action, and even by 
mouse -clicking the update button in any screen, the image 
quality adjustment processing is performed in which all the 
parameters of the latest adjusted gradation processing, 
luminance correction processing, and frequency processing are 
reflected. 

Furthermore, by mouse-clicking the "initialize" 
button 505 representatively shown in Fig. 19, the image 
quality parameters before mouse-clicking the presently 
adjusted "storage" button 507 (or "new storage" button 506) 
are all returned back to original values . 

Additionally, by mouse-clicking the "new storage" 
button 506, the adjusted image quality parameter is 
associated with the photography condition and part ("image 
quality") set in the basic processing screen (see Fig. 22), 
and a new image processing condition is prepared as 
illustrated in Tables 1 to 3 . 
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Moreover, by mouse-clicking the "storage" button 507, 
the initial image processing condition extracted in the step 
g2 of Fig. 17 is rewritten to the image processing condition 
provided with the presently adjusted image quality parameter. 

The "exit" button 508 closes the image quality 
adjustment combo box (Figs. 19 to 22). 

In the present embodiment, as described above, the 
image quality parameter (image processing condition) is added, 
updated, or deleted. 

Fig. 23 is a diagram showing the masking dialog box. 
The masking dialog box is displayed by mouse-clicking the 
"tool (T)" button on the screen of Fig. 18, and clicking the 
"masking (M) " button among the displayed buttons. 

In the masking dialog box shown in Fig. 23, a mask 
parameter setting column 541 and image quality combo box 542 
are displayed. These will be described later. 

Fig. 24 is a diagram showing one example of the 
medical image subjected to a masking processing. 

When the masking processing is performed, the 
original image is displayed only in a set area of interest 
543, and a dark image with the lowered luminance for the 
designated coefficient (mask level) is displayed in the area 
except the area of interest 543. 

Turning back to Fig. 23, the masking dialog box of 
Fig. 23 will be described. 

In the mask parameter setting column 541 of the 
masking dialog box, a shape of the area of interest (mask 




shape; rectangular or circular), brightness of the area 
except the area of interest (mask level), dimension of the 
area of interest (mask size X, mask size Y) , magnification of 
the image in the area of interest, and on/off of "synchronous 
link" (described later) are set. The center point of the 
area of interest is designated by placing a mask cursor in a 
desired position on the screen shown in Fig. 18 and eliciting 
the cursor. 

Fig. 25 is a diagram showing that two medical images 
are arranged and displayed. 

This embodiment is provided with a mode in which in 
the step gl of Fig. 17 another image (comparative image) is 
inputted together with the original image, and these two 
medical images are arranged and displayed as shown in Fig. 25. 
In this case, by turning on the "synchronous link", a 
"synchronous link processing" is performed, the position and 
dimension of the area of interest designated with respect to 
the original image are also effective with respect to the 
comparative image, and the same area of interest is set with 
respect to two medical images. In this manner, the past and 
present images of the same patient are arranged, compared 
with each other and observed, which is convenient for 
observation . 

Moreover, in the image quality combo box 542 of the 
masking dialog box of Fig. 23, "image quality", "image 
quality application", "automatic recognition application" are 
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For the "image quality", with respect to the area of 
interest, it is designated the image quality parameter for 
performing the quality adjustment processing among a 
plurality of image quality parameters, each of which 
parameters is suitable for observation of each part selected 
from a plurality parts of a body. 

Moreover, for the "image quality application", with 
respect to the designated area of interest, it is selected 
whether the image quality adjustment processing using the 
image quality parameter selected in the "image quality", or 
simply the masking processing of the original image is to be 
performed. 

Furthermore, when the "automatic recognition 
processing" is turned on, the part appearing in the area of 
interest of the display image is automatically recognized, 
and the image quality adjustment processing is performed in 
accordance with the recognized part and reflected in the 
display image. In his case, even when the part is designated 
in the column of "image quality", the automatically 
recognized part has priority. 

Fig. 26 is a flowchart of the masking processing. 

Here, first the original image, and various 
parameters or flags for the masking processing are inputted, 
and the comparative image is also inputted as occasion 
demands (step hi). Among these, the original image and 
comparative image are inputted beforehand in the step gl of 
Fig. 17, and the parameter and flag are inputted on the 



masking dialog box of Fig. 23. 

In the next step h2 , a mask image is generated as 

follows . 

The original image is set to S(x, y, z, t, b), and 
5 the mask image is set to D(x, y, z, t, b). Here, as 

described above, x, y, z, t, b denote the position of the 
horizontal direction, position of the vertical direction; 
depth, time, and band, respectively. The z (depth) indicates 
a case in which three-dimensional information obtained by MRI 
10 or the like is handled, t (time) denotes a case in which time 
p information (dynamic image) of ultrasonic wave, endoscope or 

%j the like is handled, and b (band) denotes distinction of R, G, 

fssfs 

V; B, for example, when an image of three colors R, G, B is 

*T% handled, 

11s 

T5 Moreover, when the mask level (0.0 to 1.0) is set to 

j"[ Level, and black pixel value is set to Black, the mask image 

D(x, y, z, t, b) is formed based on the following equation: 
£f D(x, y, z, t, b) = (1.0-Level)»S(x, y, z, t, 

b ) + ( Level'Black ) . . . ( 5 ) 

20 The mask image D(x, y, z, t, b) is an image in which the 

luminance of the original image S(x, y, z # t, b) is lowered 

in accordance with the mask level Level. 

It is judged in step h3 whether an automatic part 

recognition processing application flag is on/off. When the 
25 automatic part recognition processing flag is on, in step h4 

the automatic part recognition processing is executed. The 

automatic part recognition processing will be described later. 



Moreover, it is judged in step h5 whether an image 
quality adjustment processing application flag is on/off. 
When the flag is on, the processing advances to step h6 to 
execute the image quality adjustment processing. 

Furthermore, in step h7 , an enlargement/reduction 
processing of the area of interest is performed, and in step 
h8 , the potion of the area of interest in the mask image 'is 
replaced with the image (image of area of interest) 
constituted by extracting only the area of interest after the 
image quality adjustment processing. 

Additionally, it is judged in step h9 whether a 
synchronous link processing application flag is on/off. When 
the flag is on, in step hlO, also the comparative image is 
subjected to the processing of steps h2 to h8 . 

In step hll, the image subjected to the masking 
processing in this manner is displayed. 

It is judged in step hl2 whether the next mouse 
operation for the user indicates the end of the masking 
processing, or the instruction for the new masking processing 
of designating a new area of interest. In an end processing, 
this masking processing is ended, the masking image is closed, 
and the usual display image without any masking is recovered. 
When the new masking processing is designated, the processing 
returns to the step h3 . 

The image in which the area of interest is easily 
observed is displayed by the aforementioned masking 
processing . 
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Fig. 2 7 is a diagram showing a scanning dialog box. 
This scanning dialog box is displayed by mouse-clicking the 
"tool ( T ) " button on the screen of Fig. 18 , and clicking 
"scanning (S) button among the displayed buttons. 

In the scanning dialog box shown in Fig. 27, a 
scanning parameter setting column 551 and image quality combo 
box 552 are displayed. These will be described later. 

Fig . 28 is a diagram showing the display image 
subjected to the scanning processing. 

When the scanning processing is performed, only an 
area of interest 553 is displayed, and the area except the 
area of interest 553 is masked. The area of interest 553 is 
scanned downward from the top of the screen in the example 
shown in Fig. 28. 

Turning back to Fig. 27, the scanning dialog box of 
Fig. 27 will be described. 

In the scanning parameter setting column 551 of the 
scanning dialog box, a scan direction (vertical direction or 
horizontal direction), mouse capture (on: repeated 
scanning/off: only one scanning), dimension of area of 
interest (scan size X, scan size Y) , magnification of the 
image in the area of interest, and on/off of the "synchronous 
link" are set. The center point of the area of interest is 
designated by placing a mouse cursor in the desired position 
on the screen shown in Fig. 1 and clicking the cursor. 

By turning on the "synchronous link", the 
synchronous link processing is performed, the position and 




dimension of the area of interest designated with respect to 
the original image are also effective with respect to the 
comparative image, and the same area of interest is set with 
respect to two display images. The area of interest is 
synchronized and scanned in the same direction. In this 
manner, the past and present images of the same patient are 
arranged, compared with each other and observed, which is 
convenient for observation. This scanning processing is 
effective in examining symmetry of a human body. As the scan 
direction "horizontal" can be set, so that sideways display 
of the image is handled. 

Moreover, in the image quality combo box 5 52 of the 
scanning dialog box of Fig. 27, "image quality", "image 
quality application", "automatic recognition application" are 
set . These are the same as those of the image quality combo 
box 542 of the masking processing screen of Fig. 23, and 
redundant description is omitted. 

Fig. 29 is a flowchart of the scanning processing. 
Here, first the original image, and various 
parameters and flags for the\scanning processing are inputted, 
and the comparative image is also inputted as occasion 
demands (step jl). Among these\ the original image and 
comparative image are inputted beforehand in the step gl of 
Fig. 17, and other parameters and Vlags are inputted on the 
scanning dialog box of Fig. 27. \ 

It is judged in the next step 12 whether an 
automatic part recognition processing application flag is 



on/off. When the automatic part recognition processing 
application flag is on, the automatic part recognition 
processing is executed in step 13. 

Moreover, it is judged in step 14 whether the image 
quality adjustment processing application flag is on/off, and 
when the flag is on, the processing advances to step 15 to 
execute the image quality adjustment processing. 

Furthermore, the enlargement/reduction processing of 
the area of interest is performed in step 16, further it is 
judged in step 17 whether the synchronous link processing 
application flag is on/off, and when the flag is on, in step 
18, the comparative image is also subjected to the processing 
of steps 12 to 16, 

In step 19, the image subjected to the scanning 
processing in this manner is displayed. 

It is judged in step 110 whether or not the 
instruction for ending the scanning processing by the user is 
given, and with the end instruction, this scanning processing 
ends, the scanning screen is closed and the usual display 
image is returned. 

It is judged in step ill whether or not one scanning 
of the area of interest ends. When the scanning has not 
ended yet, the processing returns to the step 12 to repeat 
the similar processing on the area of interest which has 
slightly moved from the position of the previous area of 
interest . 

When it is judged in the step ill that one scanning 




ends, the processing advances to step 112 to judge whether a 
mouse capture processing application flag is on/off. When no 
mouse capture processing is applied, the scanning processing 
is ended. When the mouse capture processing is applied, the 
processing returns to the step 12, and the similar processing 
is repeated with respect to the area of interest which has 
returned to a head position. 

Additionally, by operating a mouse during execution 
of the scanning processing the area of interest stops, and by 
operating the mouse again the scanning of the area of 
interest is continued. 

Fig. 30 is a flowchart of the automatic part 
recognition processing. The automatic part recognition 
processing is executed by the step h4 of the masking 
processing (Fig. 26), or the step 13 of the scanning 
processing (Fig. 29). Additionally, step jl of the automatic 
part recognition processing is executed only for the first 
time, and only step j2 is executed for the second and 
subsequent times with respect to the same image. 

In the step jl, map data indicating respective part 
positions in one piece of medical image is prepare, and in 
the step j2, the part appearing in the area of interest is 
recognized based on the prepared map data. 

Figs. 31 to 4 2 are explanatory views of a map data 
preparation processing procedure in the step jl of Fig. 30. 
Here, the recognition processing of the respective parts in 
the chest front simple radiophotography image will be 



described. 

(1) The pixel of the original image is curtailed to 
1/8 to form a reduced image (Fig. 31). 

(2) By subjecting the luminance to a threshold 
5 value processing "external part" is obtained (Fig. 32). 

(3) By positional information that the part is 
adjacent to the "external part" 601 and the threshold value 
processing "subcutaneous part" 602 is obtained (Fig. 33). 

(4) From information that the "external" and 

10 "subcutaneous" parts are rapidly cut off on the luminance 
P value "shield plate" 603 is obtained (Fig. 34). 

-is! 

^1 (5) Based on the positional information on the 

=K image and threshold value processing "right lung" 604 is 

111 

\Q obtained (Fig. 35). 

-J.5 (6) Based on the positional information on the 

j K : image and threshold value processing "left lung" 605 is 

!rj obtained (Fig. 36). 

n 

ji; (7) From the positional information on the image 

and dimensional information that the part is held between the 
20 left and right lungs "heart" 606 is obtained (Fig. 37). 

(8) Based on the positional information on the 
image "diaphragm" 607 is obtained (Fig. 38). 

(9) Based on the positional information on the 
image "spinal cord" 608 is obtained (Fig. 39). 

25 (10) Based on the positional information on the 

image "mediastinum" (except the spinal cord and heart) 609 is 
obtained (Fig. 40). 



(11) Based on the positional information on the 
image "abdomen" 610 is obtained (Fig. 41). 

(12) Based on the positional information on the 
image "right shoulder", "right armpit", "left shoulder", 
"left armpit" (area 611) is obtained (Fig. 42). Fig. 42 
integrally shows the area 611, but a lower 1/3 part of the 
area shows the armpit and an upper 2/3 part shows the 
shoulder, and the respective areas of "right shoulder", 
"right armpit", "left shoulder", "left armpit" are 
geometrically divided. 

In step jl of Fig. 30, by these measures, the map 
data of the respective parts is obtained. 

In step j2 of Fig. 30, the part corresponding to the 
center coordinate point of the area of interest is recognized. 

In the present embodiment, the image which is easily 
observed by the user is displayed as described above. 

Additionally, in the aforementioned embodiment, 
mainly the examples of the medical image on the radiograph 
have been described, but the present invention is not limited 
to the radiograph, and the present invention can be applied, 
for example, to the medical image by an ultrasonic diagnosis 
device, a medical image by a stomach camera, a medical image 
by MRI , and various other medical images. 

As described above, according to the present 
invention, the appropriate image processing is always 
performed irrespective of the medical image type and the 
image high in diagnosis ability can constantly be provided. 



